AI-based detection of contrast-enhancing MRI lesions in patients with multiple sclerosis.

BACKGROUND Contrast-enhancing (CE) lesions are an important finding on brain magnetic resonance imaging (MRI) in patients with multiple sclerosis (MS) but can be missed easily. Automated solutions for reliable CE lesion detection are emerging; however, independent validation of artificial intelligence (AI) tools in the clinical routine is still rare. METHODS A three-dimensional convolutional neural network for CE lesion segmentation was trained externally on 1488 datasets of 934 MS patients from 81 scanners using concatenated information from FLAIR and T1-weighted post-contrast imaging. This externally trained model was tested on an independent dataset comprising 504 T1-weighted post-contrast and FLAIR image datasets of MS patients from clinical routine. Two neuroradiologists (R1, R2) labeled CE lesions for gold standard definition in the clinical test dataset. The algorithmic output was evaluated on both patient- and lesion-level. RESULTS On a patient-level, recall, specificity, precision, and accuracy of the AI tool to predict patients with CE lesions were 0.75, 0.99, 0.91, and 0.96. The agreement between the AI tool and both readers was within the range of inter-rater agreement (Cohen's kappa; AI vs. R1: 0.69; AI vs. R2: 0.76; R1 vs. R2: 0.76). On a lesion-level, false negative lesions were predominately found in infratentorial location, significantly smaller, and at lower contrast than true positive lesions (p < 0.05). CONCLUSIONS AI-based identification of CE lesions on brain MRI is feasible, approaching human reader performance in independent clinical data and might be of help as a second reader in the neuroradiological assessment of active inflammation in MS patients. CRITICAL RELEVANCE STATEMENT Al-based detection of contrast-enhancing multiple sclerosis lesions approaches human reader performance, but careful visual inspection is still needed, especially for infratentorial, small and low-contrast lesions

Multiscale Kernels 2004/2/19

Abstract This paper reconstructs multivariate functions from scattered data by a new multiscale technique. The reconstruction uses standard methods of interpolation by positive definite reproducing kernels in Hilbert spaces. But it adopts techniques from wavelet theory and shift–invariant spaces to construct a new class of kernels as multiscale superpositions of shifts and scales of a single compactly supported function ϕ. This means that the advantages of scaled regular grids are used to construct the kernels, while the advantages of unrestricted scattered data interpolation are maintained after the kernels are constructed. Using such a multiscale kernel, the reconstruction method interpolates at given scattered data. No manipulations of the data (e.g. thinning or separation into subsets of certain scales) are needed. Then, the multiscale structure of the kernel allows to represent the interpolant on regular grids on all scales involved, with cheap evaluation due to the compact support of the function ϕ, and with a recursive evaluation technique if ϕ is chosen to be refinable. There also is a wavelet–like data reduction effect, if a suitable thresholding strategy is applied to the coefficients of the interpolant when represented over a scaled grid. Various numerical examples are presented, illustrating the multiresolution and data compression effects.

Three-dimensional deep learning with spatial erasing for unsupervised anomaly segmentation in brain MRI

Purpose!#!Brain Magnetic Resonance Images (MRIs) are essential for the diagnosis of neurological diseases. Recently, deep learning methods for unsupervised anomaly detection (UAD) have been proposed for the analysis of brain MRI. These methods rely on healthy brain MRIs and eliminate the requirement of pixel-wise annotated data compared to supervised deep learning. While a wide range of methods for UAD have been proposed, these methods are mostly 2D and only learn from MRI slices, disregarding that brain lesions are inherently 3D and the spatial context of MRI volumes remains unexploited.!##!Methods!#!We investigate whether using increased spatial context by using MRI volumes combined with spatial erasing leads to improved unsupervised anomaly segmentation performance compared to learning from slices. We evaluate and compare 2D variational autoencoder (VAE) to their 3D counterpart, propose 3D input erasing, and systemically study the impact of the data set size on the performance.!##!Results!#!Using two publicly available segmentation data sets for evaluation, 3D VAEs outperform their 2D counterpart, highlighting the advantage of volumetric context. Also, our 3D erasing methods allow for further performance improvements. Our best performing 3D VAE with input erasing leads to an average DICE score of 31.40% compared to 25.76% for the 2D VAE.!##!Conclusions!#!We propose 3D deep learning methods for UAD in brain MRI combined with 3D erasing and demonstrate that 3D methods clearly outperform their 2D counterpart for anomaly segmentation. Also, our spatial erasing method allows for further performance improvements and reduces the requirement for large data sets

A systematic approach to deep learning-based nodule detection in chest radiographs

Abstract Lung cancer is a serious disease responsible for millions of deaths every year. Early stages of lung cancer can be manifested in pulmonary lung nodules. To assist radiologists in reducing the number of overseen nodules and to increase the detection accuracy in general, automatic detection algorithms have been proposed. Particularly, deep learning methods are promising. However, obtaining clinically relevant results remains challenging. While a variety of approaches have been proposed for general purpose object detection, these are typically evaluated on benchmark data sets. Achieving competitive performance for specific real-world problems like lung nodule detection typically requires careful analysis of the problem at hand and the selection and tuning of suitable deep learning models. We present a systematic comparison of state-of-the-art object detection algorithms for the task of lung nodule detection. In this regard, we address the critical aspect of class imbalance and and demonstrate a data augmentation approach as well as transfer learning to boost performance. We illustrate how this analysis and a combination of multiple architectures results in state-of-the-art performance for lung nodule detection, which is demonstrated by the proposed model winning the detection track of the Node21 competition. The code for our approach is available at https://github.com/FinnBehrendt/node21-submit

MRI-Based Brain Volumetry at a Single Time Point Complements Clinical Evaluation of Patients With Multiple Sclerosis in an Outpatient Setting

Purpose: Thalamic atrophy and whole brain atrophy in multiple sclerosis (MS) are associated with disease progression. The motivation of this study was to propose and evaluate a new grouping scheme which is based on MS patients' whole brain and thalamus volumes measured on MRI at a single time point.Methods: In total, 185 MS patients (128 relapsing-remitting (RRMS) and 57 secondary-progressive MS (SPMS) patients) were included from an outpatient facility. Whole brain parenchyma (BP) and regional brain volumes were derived from single time point MRI T1 images. Standard scores (z-scores) were computed by comparing individual brain volumes against corresponding volumes from healthy controls. A z-score cut-off of −1.96 was applied to separate pathologically atrophic from normal brain volumes for thalamus and whole BP (accepting a 2.5% error probability). Subgroup differences with respect to the Symbol Digit Modalities Test (SDMT) and the Expanded Disability Status Scale (EDSS) were assessed.Results: Except for two, all MS patients showed either no atrophy (group 0: 61 RRMS patients, 10 SPMS patients); thalamic but no BP atrophy (group 1: 37 RRMS patients; 18 SPMS patients) or thalamic and BP atrophy (group 2: 28 RRMS patients; 29 SPMS patients). RRMS patients without atrophy and RRMS patients with thalamic atrophy did not differ in EDSS, however, patients with thalamus and BP atrophy showed significantly higher EDSS scores than patients in the other groups.Conclusion: MRI-based brain volumetry at a single time point is able to reliably distinguish MS patients with isolated thalamus atrophy (group 1) from those without brain atrophy (group 0). MS patients with isolated thalamus atrophy might be at risk for the development of widespread atrophy and disease progression. Since RRMS patients in group 0 and 1 are clinically not distinguishable, the proposed grouping may aid identification of RRMS patients at risk of disease progression and thus complement clinical evaluation in the routine patient care

Single-subject analysis of regional brain volumetric measures can be strongly influenced by the method for head size adjustment

Purpose Total intracranial volume (TIV) is often a nuisance covariate in MRI-based brain volumetry. This study compared two TIV adjustment methods with respect to their impact on z-scores in single subject analyses of regional brain volume estimates. Methods Brain parenchyma, hippocampus, thalamus, and TIV were segmented in a normal database comprising 5059 T1w images. Regional volume estimates were adjusted for TIV using the residual method or the proportion method. Age was taken into account by regression with both methods. TIV- and age-adjusted regional volumes were transformed to z-scores and then compared between the two adjustment methods. Their impact on the detection of thalamus atrophy was tested in 127 patients with multiple sclerosis. Results The residual method removed the association with TIV in all regions. The proportion method resulted in a switch of the direction without relevant change of the strength of the association. The reduction of physiological between-subject variability was larger with the residual method than with the proportion method. The difference between z-scores obtained with the residual method versus the proportion method was strongly correlated with TIV. It was larger than one z-score point in 5% of the subjects. The area under the ROC curve of the TIV- and age-adjusted thalamus volume for identification of multiple sclerosis patients was larger with the residual method than with the proportion method (0.84 versus 0.79). Conclusion The residual method should be preferred for TIV and age adjustments of T1w-MRI-based brain volume estimates in single subject analyses